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TITLE: System and method for three dimensional image acquisition and 
processing of a borehole wall 



ABPL: 

This invention provides a three dimensional image acquisition and 
processing method and system that enable three dimensional viewing of an 
underground borehole wall. Also provided are a cylindrical straight 
prism and a counter cylindrical straight prism that are used in this 
method and system of three dimensional viewing of a borehole wall. 

BSPR: 

This invention relates to a three dimensional image acquisition and 
processing system and method, as well as a cylindrical prism used in the 
method and system that enables three dimensional viewing of an 
underground borehole wall. 

BSPR: 

In the field of geological survey, it is necessary to know the serial 
condition of the face, as well as the direction of strata, fractures, 
and other underground information. However, in the past, only a two - 
dimensional image of the borehole wall was available from the existing 
borehole survey methods. Because of that, even when there is a void or a 
crack in the borehole wall, or the borehole shape is deformed due to the 
ground stress, the information available was not clear and it was 
difficult to identify such existing faults. One previous method of 
conducting these geological surveys was conducted by lowering a probe 
with the TV camera into the borehole to examine the borehole wall 
directly. In this system, the image of the borehole wall was reflected 
to the TV camera by a plane mirror which was placed at a 45 angle in 
relation to the borehole wall. 

BSPR: 

Another method was developed where a cylindrical probe moved up and down 
in the borehole and the portion toward the side wall was equipped with a 
transparent window. Re: MIRROR FOR PRODUCING A DEVELOPMENT PICTURE OF 
THE WALL OF A BOREHOLE IN THE GROUND AND DEVICE THEREFORE (U.S. patent 
application Ser. No. 07/867,226, filed Jun. 5, 1992). The probe 
contained a truncated conical mirror that had a hole in the direction of 
center axis, and also had a side face that was treated with metal 
plating or some other reflective material, in order to create a mirror 
effect. This truncated conical mirror was placed so that the reflection 
of the image of the borehole wall through the transparent window would 
reflect in the direction of the axis. An azimuth compass was placed 
below the truncated conical mirror in order to detect direction, and a 
TV camera was placed above the truncated conical mirror to capture 
through the center hole the reflection from the conical mirror and the 
direction indicated by the azimuth compass. 

BSPR: 

It is, therefore, an object of the present invention to provide a three 
dimensional image acquisition and processing method that enables three 
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dimensional viewing of an underground borehole wall. 
BSPR: 

Another object of the invention is to provide a three dimensional image 
acquisition and processing system that enables three dimensional viewing 
of an underground borehole wall . 

BSPR: 

Thus, in accordance with one aspect of the present invention, there is 
provided a method for producing a three dimensional image of a borehole 
wall . The method comprises the steps of receiving a first visual image 
from a portion of a borehole wall through a first cylindrical prism, 
wherein the first cylindrical prism is located in the interior of the 
borehole; receiving a second visual image from the portion of the 
borehole wall through a second cylindrical prism, wherein the second 
cylindrical prism is located in the interior of the borehole and 
adjacent to the first cylindrical prism, and the second visual image is 
from a different orientation of the borehole wall than the first visual 
image; reflecting the first visual image on a conical mirror that is 
located inside the first cylindrical prism to create a first ring shaped 
image of the borehole wall; reflecting the second visual image on the 
conical mirror to create a second ring shaped image of the borehole wall 
that is located adjacent to the first ring shaped image; and processing 
the first and second ring shaped images by dividing the images into 
sections in order to create a left eye viewing image and a right eye 
viewing image. 

BSPR: 

In accordance with another aspect of the present invention, there is 
provided a system for producing a three dimensional image of a borehole 
wall, comprising a surveying body device; a first cylindrical prism 
having a central axis, wherein the first cylindrical prism is connected 
to the surveying body device; a second cylindrical prism having a 
central axis, wherein the second cylindrical prism is placed adjacent to 
and below the first cylindrical prism, the central axis of the second 
cylindrical prism is aligned with the central axis of the first 
cylindrical prism, a first image of the borehole wall passes through the 
first cylindrical prism, and a second image of the borehole wall passes 
through the second cylindrical prism; a camera device connected to the 
surveying body device;, a conical mirror device having a center axis and 
connected to the surveying body device, wherein the conical mirror 
device is located in the interior of both prisms and the central axis of 
the conical mirror device aligned with the center axis of both the first 
cylindrical prism and the second cylindrical prism, the first image of 
the borehole wall is received from the first cylindrical prism and 
reflected by the conical mirror device to the camera device, and the 
second image of the borehole wall is received from the second 
cylindrical prism and reflected by the conical mirror device to the 
camera device; and an image processing device connected to the camera 
device, wherein the first and second images of the borehole wall from 
the camera device are received by the image processing device, and the 
image processing device converts the first and second images o£±h& — * 
borehole wall into a pair of stereoscopic images that includes/a leftj 
eye image and a right eye image which then can be viewed with 3-D 
glasses to simulate a three dimensional image. Preferably, the first 
cylindrical prism is a cylindrical straight prism and the second 
cylindrical prism is a counter cylindrical straight prism, wherein the 
cylindrical straight prism and the counter cylindrical straight prism 
are made of a transparent material, the cylindrical straight prism and 
the counter cylindrical straight prism comprise a plurality of 
triangular columns, preferably along the outer perimeter, but can be 
along the inner perimeter, and each of a plurality of grooves is between 
a corresponding pair of the plurality of triangular columns. Also, 
preferably, each of the plurality of triangular columns has a 
cross-sectional shape of a right triangle. 

BSPR: 

In accordance with additional preferred embodiments, the system further 
comprises a correctional convex lens device partitioned relative to the 
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conical mirror device and the camera device, such that all images that 
pass through the first cylindrical prism or the second cylindrical prism 
intersect the center axis of the conical mirror at a right angle. 
Preferably, the conical mirror device is a rotating parabolic mirror, 
positioned relative to the first and second cylindrical prisms such that 
all images that pass through the first cylindrical prism or the second 
cylindrical prism intersect the center axis of the conical mirror device 
at a right angle. Also, preferably, the conical mirror device is a flat 
top conical mirror that includes a hole or a cylinder shaped transparent 
material positioned along the center axis of the conical mirror device, 
wherein an image of an azimuth compass is received at the camera along 
with the images of the borehole wall. 

DRPR: 

FIG. 28 is a graphical representation of the three dimensional image 
processing . 

DEPR: 

Before beginning a discussion of the invention, it may be well to review 
the prior art as shown in FIG. 30. The cylindrical probe 31 moves up and 
down the borehole and the portion of the cylindrical probe 31 facing 
toward the sidewall is equipped with a transparent cylindrical window 3 9 
having an outside diameter substantially equal to that of the probe 31. 
A truncated conical mirror 61 has a face F that is treated with metal 
plating to create the mirror effect, and has a cylindrical hole 20 
located in the direction of the center axis C. The truncated conical 
mirror 61 is located so that the reflection of an image from borehole 
wall through the transparent window 39 will reflect toward to the TV 
camera lens located above of the conical mirror. An azimuth compass 3 5 
is placed below the truncated conical mirror 61, and a TV camera 34 is 
placed above the truncated conical mirror 61 to capture both the image 
reflection and the azimuth compass image. 

DEPR: 

For example, lowering the combined Fresnel prism by distance L will 
result in the movement of the cylindrical Fresnel prism 5 to a depth of 
point m.sub.2. The image of the circumference of the borehole wall 4 
from point m.sub.2 is viewed at angle .theta. to the center axis C 
inside of the Fresnel prism 5. The image of the circumference of the 
borehole wall 4 from m.sub.2 is obtained with a parallax angle of 2. By 
processing each image as a two dimensional image with one for the right 
eye and the other for the left eye, the images of the circumference of 
the borehole wall 4 can be produced as is explained below. Furthermore, 
by acquiring the images from the Fresnel prism 5 and the counter Fresnel 
prism 6 separately and continuously by means of video equipment, two 
separate images of the same point captured from two different 
orientations, the right and left eye images of the entire circumference 
of the borehole wall 4 can be processed . 

DEPR: 

As shown in FIG. 5, the Fresnel prism 5 and the counter Fresnel prism 6 
are stacked on top of each other along the direction of the axis C. 
Also, a conical mirror 7 is aligned along this same axis C. The length 
of conical mirror 7 can be either longer or shorter than that of the 
combined prisms 5 and 6, but should not be exactly the length of stacked 
Fresnel prisms 5 and 6. Optical beams F pass through the side of the 
Fresnel prisms 5 and 6 and travels toward the central axis C, and then 
are reflected by the conical mirror 7 in the direction of the axis C. A 
camera 8 is placed above the conical mirror 7 along axis C and captures 
the images reflected by conical mirror 7. Camera 8 can be either a still 
photo or a video camera . The two images, of which one is passed through 
Fresnel prism 5 and the other is passed through Fresnel prism 6, are 
both shown in the conical mirror image as an outside ring image and an 
inside ring image, of the circumference of the borehole wall 4, and will 
be captured separately. The image of the circumference of the borehole 
wall 4 will pass through the counter Fresnel prism 6 on the bottom 
portion, and the image of the circumference 4 passing through the 
Fresnel prism 5 on the top portion of the connected cylindrical Fresnel 
prisms 5 and 6 . 
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DEPR: 

As shown in FIG. 6, when capturing an image reflected by conical mirror 
7 by a camera, the inside of the ring 9 will be the image of the upper 
portion of the borehole wall 4 from the Fresnel prism 5, and the outside 
of the ring 10 will be the image of the bottom portion of the borehole 
wall from the counter Fresnel prism 6 . 

DEPR: 

Another embodiment is shown in FIG. 7. Here, a conical mirror 11 is 
installed in the Fresnel prism 5, and another conical mirror 12 is 
installed in the counter Fresnel prism 6, with the prisms located on top 
of each other and the apexes of the conical mirror 11 and 12 pointing in 
opposite directions. A pair of cameras 102 and 103, one for the Fresnel 
prism 5, and the other for the counter Fresnel prism 6, are placed to 
capture the ring shaped images F of the borehole wall 4 separately. 

DEPR: 

The image of the circumference acquired in the above method will be 
transmitted to above ground equipment by means of cable, or other 
method. The image viewed on the monitor will appear as shown in FIG. 6. 
This analog data of the image will then be converted into digital data 
and put in a preliminary image memory, where it will be broken up into a 
matrix of pixels. Pixels on the circumference of each scan will be 
extracted one by one and realigned to form a processing routine in the 
image processing memory. This process will be repeated as the conical 
mirror moves through the borehole, and a continuous image will be 
processed . The distance of the movement of the conical mirror in the 
borehole is measured by such equipment as a depth measuring device, 
where an electric pulse from the device will send a signal to repeat the 
routine automatically. 

DEPR: 

As described below, there are two methods to process a set of images 
(one for the left eye and one for the right eye) for the purpose of 
three dimensional image viewing. 

DEPR: 

As shown in FIG. 9, the direction of optical beams r.sub.l and r.sub.2 
from the borehole wall 4 (looking upward along the center axis C) , which 
corresponds to scan lines P and Q, create a parallactic angle of 
2.theta., and enter the conical mirror 7 at an angle of 260 . As shown 
in FIGS. 10(a) and 10(b), each horizontal line P and Q represent one 
revolution of the three-dimensional imaging device, as shown in FIG. 9. 
The image of scan line P is shown ahead by .alpha, in the S direction in 
the ring shaped image, and will be the start of processing . Point Z of 
the processed image display will be the image 13 for the left eye. 
Likewise, as shown in FIG. 10(b), the image of scan line Q is behind by 
.alpha, in the S direction in the ring shaped image, and will be the 
image 14 for the right eye. As shown on FIG. 4, the image on scan line P 
is viewed a distance L above the scan line Q. The image of scan line Q 
will then be processed and displayed ahead by a distance equivalent to 
L, as shown in FIG. 10(a) . 

DEPR: 

The second method of image processing is shown in FIG. 11. Scan lines P 
and Q are established in the ring-shaped image by the same method as 
that described in FIG. 9. The scan will proceed clockwise, and the 
images from scan line P will be for the left eye, and the images from 
scan line Q will be for the right eye. The image of scan line P is shown 
ahead by .alpha, in the S direction, while the position to start 
processing is behind by -.alpha, counterclockwise in the S direction. 
Each pixel that is obtained is inputted starting from position S at the 
far left of the processed image memory, as shown in FIG. 12(a) . It is 
then displayed in a monitor, and becomes the image 13 for the left eye. 
Likewise, the image of scan line Q is behind by -.alpha., while the 
position to start processing is ahead by .alpha, clockwise in the S 
direction in the preliminary image memory. Each pixel that is obtained 
is inputted starting from position S at the far left of the processed 
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image memory as shown in FIG. 12(b) . It is also displayed in a monitor, 
and becomes the image 14 for the right eye. The image of scan line P is 
viewed from above the image of scan line Q by a difference equivalent to 
L . Furthermore, the image of scan line Q will start displaying ahead by 
distance L in the process image memory. 

DEPR: 

In a situation where the orientation of the acquired image is important, 
it is possible to design the structure so that the orientation is 
controlled automatically by rotating the camera by means of a direction 
control device about the axis, while the top of the image is always 
facing N as shown in FIGS. 8 and 11. This is done in the same manner as 
indicated in a prior art system in FIG. 30, specifically the image of 
the azimuth compass is viewed through a hole in the center of the 
conical mirror which is aligned with the center axis. The azimuth sensor 
device may be an azimuth compass having a needle or a magnetic azimuth 
sensor which provides an electronic signal. Directing towards the 
electronic signal detected by the azimuth sensor device, the TV camera 
is controlled to face a certain direction by pivoting about the center 
axis with an internal motor. The point of reference is determined by a 
certain point, such as the S direction, which is located in the 
preliminary image memory. The above point of reference for processing 
can be controlled either manually or automatically, and a direction in 
the ring-shaped image is detected by means of the needle of an azimuth 
sensor compass in the ring-shaped image or by a signal from a magnetic 
azimuth sensor . The director of the ring-shaped image is changed by 
eventually rotating the probe, but the direction of the ring-shaped 
image is detected by means of an image the needle of an azimuth sensor 
compass in the ring-shaped image or by a signal from a magnetic azimuth 
sensor so that the starting point of the scanning of the image can be 
controlled either manually or automatically to a certain direction, such 
as S . 

DEPR: 

A conical mirror is placed inside of this Fresnel prism, and as 
described above, the camera captures images from this conical mirror. 
Then, two sets of ring-shaped, divided images, are arranged alternately 
with one set of images from prism face e and the other set of images 
from prism face e ' . The method of processing these images for three 
dimensional viewing is presented below. 

DEPR: 

In a preferred embodiment, the double Fresnel prisms contain 360 
grooves. When placed in the borehole, the image of the borehole wall 4 
can be processed from two sets of 360 sections of the borehole image, of 
which each set faces a different direction. As shown in FIG. 16, 
starting from scan line U, numbers are assigned for each of the 72 0 
sections in the ring shaped image. Next, two sets of images are 
processed, one created from all of the odd numbered images and one 
created from all the even numbered images. One image is for left eye 
viewing and the other is for right eye viewing. 

DEPR: 

The method of placing the images within the processing memory is shown 
in FIG. 17. For example, if the isosceles triangle cylindrical straight 
prism has 360 columns of isosceles triangles on the surface, 720 pixels 
can be received from a scanning circle lines which relate to the 720 
sides of the isosceles triangles. Then, assign a number from, 1 to 720, 
to each pixel. These 720 pixels can be divided into an odd numbered 
group and an even numbered group . These two group form the right eye 
image and the left eye image. Next, any location error images caused by 
the refraction angle of the prism, 2. alpha, can be corrected. 

DEPR: 

As beams are received, as shown in FIG. 9, with the optical beams having 
corresponding angles .alpha, in relation to the reflection angle of the 
prism, for example, the set of pixels from the odd numbered images will 
be processed for right eye viewing, as shown in FIG. 17(a), and the set 
of pixels from the even numbered images will be processed for left eye 
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viewing, as shown in FIG. 17(b) . In the embodiment of the invention 
using the double Fresnel prism, both the left eye image and the right 
eye image can be acquired on the same scan line, therefore, it is not 
necessary to switch the upper and lower positions. In other words, the 
distance L would be equal to zero, as shown in FIG. 12. Whether each set 
of the processed images is for the left eye viewing or for the right eye 
viewing is dependent upon the position of the process starting point. By 
preparing the double Fresnel prism with a one-half cycle twist within 
the range of the isosceles triangle, an adjustment can be made by 
altering the scan diameter. By this method, the order of the pixels of 
the left eye image and right eye image can be changed. 

DEPR: 

The second embodiment of the method is when the three dimensional images 
for the left and right eyes are displayed alternately in the same place 
on a monitor screen. This method requires viewing with special eye 
glasses with a continuous operating liquid crystal shutter. 

DEPR: 

The third embodiment of the method is when the three dimensional images 
for the left and right eyes are displayed alternately, and then viewed 
using a special lens installed on the monitor screen. 

DEPR: 

The fourth embodiment of the method is to use a pair of goggles which 
have installed two small displays inside of it. The left eye image and 
right eye image will be displayed separately on each display and will 
produce the stereoscopic view. 

DEPR: 

As shown in FIG. 21, the correctional lens 21 is placed between the 
conical mirror 7 and a camera 8 to correct the optical beams F that have 
spread out vertically after passing through the Fresnel prisms 5 and 6 
in order to maintain the distance between the two light beams where the 
center axis C of the TV camera is not placed at the center axis of the 
borehole . 

DEPR: ' 

As shown in FIG. 24, the prism body 23 which, for example, is explained 
in FIG. 5, 20, 21, 22 and 23, is installed within a probe 31 that moves 
up and down the borehole by means of wire 3 0 that is connected to an 
operating system that is not shown here. Within this probe 31, a TV 
camera 34 is installed above the prism body 23, and rotates around the 
axis controlled by the camera azimuth sensor control motor 33 . The 
direction of the camera 34 is controlled by a signal from magnetic 
azimuth sensor 32. Furthermore, the magnetic azimuth sensor compass 35 
is installed below the prism body 23. A power source unit 36, a borehole 
wall lighting lamps 37, a compass lighting system 38, and a battery are 
also present in the probe 31. A transparent window 39 is installed on 
the side where the prism body 23 is located. Preferably, in order to 
keep the illumination constant, lighting lamps 37 are comprised of 
multiple small lamps. 

DEPR: 

The probe 31 is lowered underground into the borehole 4 0 as shown in 
FIG. 25. The above ground equipment comprises a depth measuring device 
41 that measures the depth of probe 31, which is connected with a wire 
30, an image recording system 42, an image processing system 43, a probe 
control system 44, and two connected monitors 45, which project the two 
images that are required for three dimensional viewing. The image 
recording system 42 consists of a digital recording device such as 
floppy disk driver, magneto optical disk driver or magnetic tape driver 
and so on. The image recording system 42 also include a VTR system which 
produces a recording. The image processing system 43 converts the analog 
TV camera image into digital and processes the conical mirror image into 
stereoscopic projected images that are directed to the azimuth signals 
which are sent from the azimuth sensor . The probe control system 44 
supplies electricity to the probe and controls the TV camera direction 
by means of a motor which installed in the probe. By using this 
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equipment, the probe 31 is lowered gradually into the borehole 4 0 to 
acquire the images for three dimensional viewing. 

DEPR: 

A continuous three dimensional image of a horizontal borehole wall 4 can 
be acquired using the embodiment as shown in FIG. 26. A conical mirror 7 
is placed inside of a cylindrical prism 50 along the direction of prism 
axis A. Cylindrical prism 50 consists of a pair of cylindrical Fresnel 
prisms. This "unit of a three dimensional image acquisition prism, 
consisting of the conical mirror 7 and cylindrical prism 50, is 
installed on top of a borehole cart 51 in a horizontal alignment. In 
addition, a borehole lighting lamp 52 and a TV camera 34 are positioned 
on top of the cart 51, and aligned with the center axis of prism 50. An 
image recording system 42, an image processing system 43, a camera and 
lighting control system 53, as well as two serial monitors. 45, are also 
installed on top of cart 51. Distance is measured by a distance 
measuring wheel 54 . Distance measuring wheel 54 has installed a pulse 
encoder which generates electric pulses in regular intervals. These 
electric pulses are sent to the image processing system and work as the 
trigger signals of the image processing routine. The present invention 
has the capability to process in real time a pair of stereoscopic images 
of the projected images of a borehole wall. By taking the measurement of 
the location of the same point in the pair of three dimensional images 
as acquired by this process, the distance between the point and the 
borehole axis (the radius of the borehole ) can be measured. 

DEPR: 

The present invention, therefore, is well -adapted to carry out the 
objects and attain the ends and advantages mentioned, as well as others 
inherent therein. While presently preferred embodiments of the invention 
have been given for the purpose of disclosure, numerous changes in the 
details of construction, arrangement of parts, and steps of the process, 
may be made which will readily suggest themselves to those skilled in 
the art and which are encompassed within the spirit of the invention and 
the scope of the appended claims. 

CLPR: 

7. The system according to claim 2 wherein the conical mirror device is 
a flat top conical mirror that includes a hole or a cylinder shaped 
transparent material positioned along the center axis of the conical 
mirror device, wherein an image of an azimuth sensor is received at the 
camera along with the images of the borehole wall. 

CLPV: 

processing the first and second ring shaped images by dividing the 
images into sections in order to create a left eye viewing image and a 
right eye viewing image . 

CLPV: 

a conical mirror device connected to the surveying body device, wherein 
the conical mirror device is located in the interior of and aligned 
along the center axis of the cylindrical prism device, wherein the first 
image of the borehole wall is received from the cylindrical prism device 
and reflected by the conical mirror device to the camera device, wherein 
the second image of the borehole wall is received from the cylindrical 
prism device and reflected by the conical mirror device to the camera 
device; and 

CLPV: 

an image processing device connected to the camera device, wherein the 
first and second images of the borehole wall from the camera device are 
received by the image processing device, wherein the image processing 
device converts the first and second images of the borehole wall into a 
a left eye image and a right eye image. 
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